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• Generating kriowledge through research 

• Developing educational programs and products 

4 Evaluating individue^l program needs and outQomes 

• Installirg educational programs and products 

• Operatinr information systems and services 

• Conducting leaderships-development and training programs 



^1 




r 



^ 



The material cor}t3ined in this document is intended for purposes of information and discussion 
only. It in no way constitutes an widorsemeni bV, or reflects a position of, the Council of Chief 
State School Officers. * ^ 

, : . , ' . 



DISCRIMINATION PROHIBITEQ,-Nq p<prson in the United States, shall, on the grourvd of race, 
color, or national origin, be excluded from participation in'^tsp-ilipiied the benefits of, or be sm^- 
jected to discrimination under any program or activity recajvlng federal financial assistance, or be so 
treated on the basis of sex under most education programs or act vities receiving federal assistance. 



The activity which is the subject of this report was supported in whole or in part by the U.S. Qffite 
of Education, Department of Health, Education, and Welfare, ^towever, the opinions expressed 
herein do not'necessarily reflect the position or policy of the U.S. Office of Education, anti no 
official endorsement by the U.S. Office ofCducatiori should be inferred. 
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Jerry viaHcer /^ Director for ^valuatiof^ whose division was respon^bl|for con^cting thfi 
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MANAGING AND EVALUATING CARtER-^DUQATION 

'J ' ' INTRODUCTIOtM ' 1 y . 

' ■ ' .. - - - . 

^ "pat Lee is the Coordinator of Career Education\n the State of Lafayette. Prior to belr^se- ' 
lected as the sta^e aodtdinator. Pat Was a'succSssful teacher in Columbia, a large ?«?fP««^'^_ 
in Lafayette. As the state coordinator for Career Education, Pat's many responslbllitles in U^yette 
include: ' ^ v ■ , , 

conducting fnservice institutes for education personnel . 
training Jocal career education coordinators; ( 

- collecting, evaluating, anddisseminal^ng career education materials; t 
cpnducting needs assessment and evaluation studies; ' i 

conducting stltev^hi^leadership copfe^ences;^ 

J — . ■ • ' ' p 

- engagingJTn bollaboratiMB relationships with other agencies of state government and with 
state organizations representing the^usiness^abor-industry-professional community;^ 

d^eloping and applying certification studies for local career erJucation coordinators; and ; 

- promoting the adaptation of teacher-traii^ing curriculum to the concept of career educa- 
til^ by institutions of Kigher education. ' ^ . - ' • 

( However in carrying out these responsibilities, Pat is constantly faced wItt? a number of ''other 
Uuirement:. ' Fo*r example, representing the state superintendent of schpols « a r^gj^^ -te^^^^ 
meeting, serving on acc^edilatirf. team visits to local schools, writmg P^^^P^^^'^^^^^^^^^ 
*and serving on a task force onTeoryanization (^f the state education agency. »ln other vvords. Pirt is . 

'ljusy ^ busy busy. 

/" 

Pat realized after joining the state education agency, that there were a number of differences 
•between the responsibilities of a teacher and those uf a state level adn^imstrator. 

* As a teacher, Pat's responsibilities included: , 

budgets in the hundreds of dollars; ' 

curricuium concerned with 3 few courses-generaily quite cio^ly related (e.g.,^l^ra, 
geometry, advanced a!gebra-or- American history, political science-ar-accountmg, 
'business law, personal finance, etc.); ' ' , ^ 



t 



- ctecisit>ni related to the day-^Hiay bias^om InstrMCtlons were generally decided-^iirectly 
by Pat with iittts input from others; andT . 

. • • / 

~ administfitive procedUi^ wereof little concern to Pat and'\ftire primaVtJy centralized 
with the^administrative staff. 

• . . ■ ■ _ ■ ■. c 

Ui contrast, as a state level administrator, Pat's responsibilities include: 

- budgets in th^thousands of dolftir^; 

- program concerns of a broader ba^-mcfuding all curriculum areas; ^ ^ 

- decisibns that are often ^ared with several person5;.and 

- administrative procedures thpt are highly structured. ^ 

• ' ♦ • " • 

Consequently, the excellent preparation Pat received to be a teacher was not necessiarilv the 
best preparation for a role as the state coordinator of career education. 

Pat concluded that the career education cqordinator's responsibilities were t**^ of manage- 
ment in contrast lo those of teaching. 

Similarly, you may hav*? realized that the requirement^ for a statfttoqrdinator of cfir#«^educa 
tion ate thos6 of management. Howevei^, a number of questions about mana^enf probably still re- 
main Unanswered. For example. What is manag^ent? What functions do managers perform? What 
are tha characteristics of managers? What evaluation techniques are available to help you do a belter 
job managm^? > , " > , 

The purpose of this paper is to: W define management and idef\Ufy basic fuhctioos, <2) review 
, characteristics of managers, and (3) identify evaluation techniques available tdShelp you do a belter 
job managing. The remainder of this paper discusse? these three^))is. - • ' , 

« / • / ■ 

WHAT IS MANAGEMENT AND ITS ASSOCIATED IFUNCTIONS? 

Although the term manapmdnt is a commonly used term, we often dotiot ^e a clear under- 
standing of the term. Levitt (1976) indicated that: ' . ' 

J, * * 

Management consists of the rational asse^ent of a sltua^on and the syst^a.ti^ selection 
of goals and purposes {what is to be done^; the systematic development s^jjratpgias to 
achieve these goals; the marshalling of the require resources? tfie r^onal t^lrsi^, organl 
' zation, direction, and control of the activities required to attain- the selected purposes; ^. 
arKi, finally, th0 motivating and rewarding of ^>eople to do the work. . ^ ' 

Another simi'-r, yet shorter, defiriition {Haimann, 1962), indicated thaf "Managenient is the 
functioq of' getting things done through people and directing the efforts of individuals toward a ^ 
comrpon objective." In carrying out the responsibilities of management (Haim^nn, 1962, p. 22) ^■ 
indicated that five functions are included: Planning, Organizing, Staff ii^Oirecting arxl Control- 



Pianninff is determining in advance what should be done. In relatlonriilp W cre«r ^^O"' 
' planning consists of selectinfl otJjectives, poHclei. pro^mi, proc»dur« and othw wayt of r^mg 
vouc objective. . ^ 

* In the absence qf plans, a state coordinator. of «^lf^^*«l ^'^P" 
>-|hg to immediate requests, often resulting in cJonfusion a«^«». A rt^te ^P^^^^^^^^T^ 
- cation should view planning as a continuous process enablWfa career «^"«|«<»^Pr^«^^ 

more proactive. Planning should help yoU amifcipate problems; ^^^^^^'J^^^J^^^^' 
tions that will alleviate the situation. However, there are ^-^^J^* 
planning efforts: 1) planned events in the future cannot be predicted ^^^f^^^^^^i^^^^^^ 
S ^u&tion is a dynamic concept. (3) change in the educational f^m ^ on»^ »Jow and 
painful process. (4) creativity can be stifled if we "cast the plans In J^) • « 

Spensive hnd time consumirtg venture. (6) emergenaes may cause prompt action le.g.. tax iisyies ^ 
turned down, weather, strikes, etc.). 

r 

• ^Organiimg infers to systematically detennining and listing the career eduf^tlon "ctlvltlw to be ' 
conducted and assigning responsibilities for completing these ac^vities. '".a^Bhinj r^wwibrntjes, 
it ii also important that you delepte the authority for completftig the activities. However, most 
state career education cooitiinators are not always able to delegate responsibilitlw «id consequAitly 
have to rely on rather- informal procedures in Qpntrast to those procedures available In larger more 
tightly controlled and administered projects. 

' Staffing, In a strict management sen«. refers, to the recruitment, ^^^''^^'^^^^^'j^bj!^^;^^ . 
ipg and cof/pensation of subordinates. As men uoned above, most state career 
. du not have lar^ staffs and it is necessary to rely on volunteer workers m f^nfing out thch^^onsl- 
b«r^es In selecting persons to work with you. in either formal or informal vvays. .t is 'n;P«?f J^^^at 
cmhmiastir and com^tent individuals be identified. In most cas^. these ,nd^..dua^w.ll1ieW to be 
able to gro«v and develop as they become more knowledgeable about career education. 

Ofrecting refers to the process a career education coordinator follows in guiding teaching coach- 
ing anl^upervising colleagues. As mentioneji e^^rlie. . career 

^efy uSn volunteers to get their work done. In")a sense, career education coofdlrw ors ^Jo under 
stand ''bow to win friends and influence people" in carrying out their «WonsibiHties^carrymg 
out this function it is essential that the career education coordinator communicates effectively. In 
5s> other words, assignments should be stated so that they are: 

(1) doable! 

(2) compatible with objectives, 
/ ^ P) understandable, 

I " (4), time defined, and 

{5j stated in a tactful manner. 

Controlling represents the final function of oianagement. This function iSconcemed with moni- 
' I activities and events seeing to it that they proceed as planned. Therefore, it .s ^t.al that 

.t. ,f be a plan of action against which you can check, in carrying out this function, the career edu- 
cition coordinator generally has three options availahle: 



(1) cofitinue thtr planned activities, ; 

(2) modify the planned activity, or . ' ■ 

(3) stop the planned activity. ^ 

* 

Finally, waluatioh, althouj^ not listed as a Sf^ific management function, is a component as- 
sociated with each of these functions. Figure 1 shows howieach of th^five management functions 
Is related to evaluation. In this paper, we are defining araluaticHi according to Stufflebeam et 
(1971). "Evaluation is the process of delineating, obtaining and.providing information for use m 
decision making." In a management role it is important to remember ^at decisions be made that> 
reflect the best use of available information. In some cases, it may be ne^ssary to obtain totally 
n#v information. Yet, in other cises you may be able to reif on existing information in maicing 
management decisions. The last section of this p^r will pr^ent different ways of obtaining evaiu 
ative information. The next section of this paper will discuss the characteristics of successful man- 
agers. ^ ^ * ' . ' 

WHAT ARE THE CHARACTERISTICS OF SUCCESSFUL MANAGERS? 

If you were to de«:ribe-a succe^ul manager, what adjectives would yoiTuse? How many dif 
ferent adjectives can you name that describe successful managers? Figure 2 lists twenty four.different 
adjectives that Campbell et al. (19701 reported being Used in an attempt to differentiate more suc- 
cessful from le» successful executives. "Just fpr fun, indicate (by placing a check under the appropri- 
ate heading) those adjectives that are most descriptive of successful f^reer education coordinators 
and those thal^re least descriptive of successful career education coordinators in their roles as man 
agers. Figure 3 reports the results^of a research -effort in which these adjectives were used in describ 
ing successful executives. Now, compare your classification with those reported 'by Campteli. How 
close was your classification to the research clarification reported by Campbell? 

■ . 'f ■ 

A great deal has bjen written about the development of managers, f aHy in our history it was 
thought that the ability to manage wat inherited. More Recently,- management ability is viewed as 
a more complex trait, but that it can be influenced through exper{enc6,^education and training. - 
Campbell et al. (197(J) has identified a large number of personal qualities that are necessary for man^ 
ageria! effectivertfss. These characteristics are presented in Figure 4. Althou^ it is often thought 
that rfianagers are' inhumane and indifferent to differing persor^at styl«, Campbell et al. (1970) stated 
that successful managers exhibit a number of k^aviors thar do, in fact, represent a humane apprc^h 
to management Figure 5 indicates most of the job behaviors that are indicative of »iccessful man- ' 
agers. You will note that most of these behaviors do represent humane characteristics. 
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Dticriptori of Caratr Eduestion Coonlinatori 



Mc9st Descriptive of Suocfissf ul 
State CanMsr Education 
Coordinators in theic^Role 
BS a Manager • 



Least Desoiptive of Successfui 
Stats Career Education 
Coordinators in Xheir. Role ' 
as a Manager 



' Ag^abfe 
Aggressive 

Amiable 

Cheerful 

Ciear-thinking 

Conforming 

Conservative 

Courteous 

Creative 

Decisive 

Determined 

Energetic 

Enterprising 

formal 

Intelligent 

Kjndly 

N^neriy 

Modest 

Neat 

Proc||ucti>^ 
Reserved 
flesponsible^ 
Self-starting 
Well informed 



/ 



Figure 3. 

♦ 

Mpst and Ue»t D«cf iptiie MfKtnm for Sucasiful Exocutivti 



Most Descriptive 
of Sucxerssfut 
Key Executive 



Decisive 
Aggressive 
Self starting 
Productive 
Well info/<ned 

Determined 

Energetic 

intelligent 
Responsible 
Enterprising 
Clear thinking 



Least Descriptive, 
of Successful 
Key Executive 



Amiable 
Conforming 

Neat 
Reserved 

Agree^le 
Conservative 

Kindly 

Ma*rtner!y 

Cheerful 

Fornnai 

Courteous 

Modest 



< 

t 

' — FigumA. 

V 

f»ERSONAL QUALITIES NECCESSARY 
FOR MANAGERIAL EFFECTIVENESS 

Able to sustain defeat 
Alert 

Ambitious— achievement-oriented 
Assertive 

Capable of good judgment 

Corn|i>etitive 

Concrete 

Creative 

Decisive 

Dedicated 

Dynamic 

Emotionally stable 
Energetic 
Extraverted 
Fearful of failure 
Group-oriented 
Honest 
Intelfi^nt 
Mentally healthy 

Optimistic and confident (as a cover up for 
fear of failure) 

Pragmatic 

Predictable ^ 
Realityioriented 
Seif-cdntroMed but defensive 
Tolerant of frustration 
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Figure 5. 




They manage work instead of pfiop!4. 



They plan and or^nize effectively. 



They set goals realistically. 



They derive decisions by group consensus 
but acc^t responsibility for them. 

They delegate frequently and effectively. 

They rely on others for help. in solving problems. 

They communicate effectively. 

They are a stimulus to action. 

They coordinate effectively. 



They cooperate with bthers. 




They show consistent and dependable behavior. 



They win gracefutiy. 



They express hostility tactfully. 
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EVALUATION TECHNIQUES USEFUL r 
IN PLANNING 



if) 



NEEDS ASSESSMENT ;v 



Background 

The career education leg^Jation (Section"4C^ and 406 of the Education Amendments of 1974) 
requires that a needs assessment be conducted prior to developing the state^lan for <»re8r educ?ar 
tion. Furthermore, the zero based ijUclgeting concept being promoted by the Carter admlnlstrationj^ 
inicudes defining educational needs as the initial step. 



Definition ^ 

Needs assessment in career education refers to the process for de1B?mining the difference be- 
tween "what is" and "what should be" occurring and for placing priorities among them. 



Example 

A number of different techniques can be used in assessing needs. For purposes of this paper, 
the process used by Florida in assessing career education needs is u«d. (Adams, Kay Angona, 
Florida Assessment of Needs in Career Education, Columbus, Ohio: The Center for Vocational 
Education, The Ohio State University, 1977.) 

i 
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Actual Attiinnwnit 

Rea stJcaMy estinruTe the percent of students in your 
distf iCt Of school who hs^sit^rmd minimal fcon^tency 
in eac^ of the following goals by the time they leave hi|^ 
ichoo' 

10*24% 26^9% 50-74% 75^89% 90-100% 



□ 



I- -J 



□ 



□ 
1.1 

□ 



□ □ 



□ 

n 
□ 



□ 

□ 
u 



Work Valuts 



10. 

11. 

12. 

13. 



Styctonti underttend how careers contribute to 
society. 

Students recognize the social and ecc^omic 
benefits of wof k»ng and understanding the coki- 
sequences of not working. 

Studenti view career roles mcfependent of sex 
stereotypes. 



Students view caree 
racisi stereotypes 



independent of 



^ Dmirwl Priority 

R«te the relative priority of mwting eKh ; 
your district or tchool. 



Low«r 
1 



□ 



□ 
□ 
□ 



3 



□ /i Q 



□ 
□ 



□ 



□ 
□ 
□ 



t , 



□ 



a 



□ 



n 
□ 

□ 
□ 



□ 
n 

L] 
□ 



:j □ □ lj 



Peciiion-Mikinfl and Job Hunting SkiHi 

14. StKC^rtts are able to reiste their goal^ to the 
process of making career decisions. 

15. A. Students are able lo ideniifv, Bather, and appiv 

mformasiOn toward career decisions. 

16. Students are able to identify and consider 
■ . alternattves whVn nnaking career related 

decisions. 

17. Students l?no*v how to hunt for jobs , 

18. Students can describe tN? personal qualities 
that employers ct^sider mbsi important when 
hiring employees. ^ 



'LJ 
□ 

□ 
□ 

□ 



□ 
□ 

n 
□ 



□ 

□ 

□ 



□ 
□ 

□ 
□ 

□ 



• ACHIEVEMENT TEST SCGtB^S ^• 

Background . ^ < . ' ' 

, There increasing emphasis being placed upon the achievement level of st^te. A -hiror has 
^mingly emerged over the apparently declitiing scores on standardized tests adminlatered on a 
mationat basis such as the Scholastic Aptitude Test. Additionally, a number of stttw are pacting 
legislation aimed at establishing minimuniccMnpetencies ttjat students r*5a|vin» dlplomasvmust 

achieve. ^ 

Definition * *^ . • , * , - 

Achievement tests scores are the results obtained from taking ar\ examination. If faith «»<o 
3 placed in these scores, The examinations should have Sufficient development effort so that rewonable 
estimates of reliability and validity can be m'dde. 

EKampfe 

One achievement test on which state career education coordinators might have;ewaluative 
information would be the National Assessment of Educational Progress-Career and Owupational 
Development. There are a number of other tests that have betn develc^Jed with enough lophistica- 
tioh to warrant their use providing the type of information. These would be available from both 
private companies and public education agencies. , 

^ \. 
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WmTING CLEAR OBJECTIVES 
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Background t ^ 

A goo« managiir has to be able;t«tde*eropxiear objectives^ ^ ILll^Z'^Stil^ Zt^e 
and so you can communrcate with Othirs. V^e various terrhs used to ^^l^jJ^^^^JJ""^^ 
somewhat confusing. Goals, intended outcomes, expected outcomes. objectivM tehwiora^^ 
^ormanceobiectives outputs, and products are some frequently used tenm. It ji uwftil to \ 
S s^ng^s^^tS^^^^^^^^ The?.rm gd^ls. objectives, outcomes |short^n^^^ 
and p?oducts seem to be th^most ustful for planning, Objectives should be. developed both for 
administrative and classroom behavior. 

Definition 

Goals and long-range 6utcomes' go together. They are both Q^"^'^^^^^*^^^^^ '° 
describe macro level accomplishments. Objectives and short-range o"^^"^^.^'^^^^^!^?^,:^^ 
VaHo^auSors d^ine go^ls and outcomes in different ways. We prefer to view goats and o^ectives 

^"e'ormL^o statement. ThI. difference be^^" ^ '''^'^''IirSf.l"^^ you 
tormer describes what vcAj are going to do-ydbr performance, while the latter describes wnatyou 
X to^;^r ar^ result of y^ur performance. A product is jHe vehic « f^^^ 
formance to a target so outcomes can occur: Some specific definitions follow. 

[ Goal. General statements of what activities will be conducted. 

~ long-range outcome. Genera! statements of the results anticlpated-may be stated in^terms 
. of students, programs or both. 

' . ^Obiective. Specific statements of what is to be accomplished or what studente will be asked to 
do, , • 

^ Sliort range outcome. Specific statements of results anticipated--may be stated ^ terms of 
students, programs or both. 

Product. Statements of output which describe a tangible item to be produced. 

Example \ 

A good way tkommunicate your objectlvw and expected outcomes to others^ to use a 
tabular for,r,at. Art example of a Program Obiectives and Outcomes format is.provided. 
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Pf^GRAN objECTlVEf^AlW OUTCOMES ^ . , 



Objtcttvn 


, ^ -V, - 

vrrodi^ts. , 


Outc0mts (Expeolid 


1 . To idpntify, validate, and 
rank local career ed direc- 
tor compf tenci^ via a \ 
^ state rteedl^assessment. ^ 


A list of-vatidated and priori- ^ 
tized CQmp6t9nde»;needed by ' 
local career ed direct|p. A ^ 
description of in-servR mate- ^ 
rials curmntiy availabif. 


A s^untl researct) upon which ' 
hf^h-pHority c<mipetency* ^ • 
basec^ inWviee triiining mate- . 
rials can be devetodbd. . 

i,: ..." 
'f 


2. To d^f^lop competency*' 

bdS&H inrG£krvi/*£i frdininn ^ 

materiat? and user guid^(sK 

1 


A %t of prototype competency^ 
Oasra insiruciionai maieriais 
and user guide(s) for the in- 
service eoucation of local' career 
ed directors. 


Local careered directors ^o 
are better planners, managers, 
curncuiunf designers ait'd'evatu- 
atois. better adnjinistrators'^ • 
wiiKrest^lt in (Programs th^ are 
n^re e^Ffective and^more effi- 
cient in meeting the need& of 
s^dents. ^ ' / 


3. To test the prototype 
in-service training mate- 
rials and user guide(s). 

"A ■ 


A detailed plan for testing $he 
in-service materials, including 
instrumentation and data on 
materrals effectivepess and 
revision suggestions. ' 


iQ-service training materials 
will prove effective fp deliver- 
ing the competenqf^ in- 
volved and usef guibals) wilt 
.help ensure tran'sporiability of 
the materials. 


4. To revise the prototype, ^ 
in-service materials and ' ^ 
user gutde(s) using field 
test feedback data' 


Rev^s^d in-service training 
material^ and user guide{s}. ^ 

1 


Impr^bved in service training ' 

*materii|ls and user guide(s) for 

iQpai career ed directors, 
• 


5. To publicize and dissemi- 
nate in-service materials 
and user guideCs)- 

r 


z { — '■ — 

Camepa-ready ^opy of all ' 
materisls. P(Qmotional mate- 
rials announcfng the avaiiabifity 
of materials. Fifty sets of the 
materials distributed to early 
adopters. 

d 


Increased in-service training ' 
' options for local career ed 
directors dye to avarfability 
of competency-based mate- 
. rials on pfiority competencies. 

^ . .. ^ 



/' , ' * 

Raferences/Resources 

• When developing program goals^and objectives for career education programs you should 
re^ierexTs^J^S of S Some source of goals and objectives for career education programs 
are: ■ • ' . ' ' • 

Ten Learner Outcomes for C^reer'Bducation (OCE, 1976) 

Developmental Program Goals for the Comprehensive Career Education Model (The Center 
for Vocational Education, 1976) ' 

Career Education/ An Introduction (the Career Education Center, Florida State University, 
1975) 



Career Development Goals and Performance /nd/cafo/>.< Michigan Department of Education, 

1974) ' , ^ 

Basic Learner Outcomes for Career Education (Texas 'Education Agency, 1973) 



I 
I 



'I 
•s. 



7 



EVALUATfON TECHI^QUES USEFUL 
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WORK BREAKDOWN STRUCTURE 



^ . There^s a lot of hard work between penning objectives and coming ^j^],^^!;^ 
evident that vour outcomes have been achieved. The stuff in between is whft.««>rk bre»^5?T ^ 
«.!Sres ari'^^^ activities and tasks. U is essential to carefully think thfrough v^at 

steps are needed to^accomplish your objectives. 

Deflation ^ . f 

A Work Br'eakdovwi Structure (WBS) is a useful tool for thinking through an activity. It li a 
teciint,^ forS'^^^^^ chunks. We prefer a three 

• breakdowns are sometimes used. These three Ifeve^s are: 

conceot employed is«ystems analysis and takes the form of hierarchical ordering d>J™^^ 

v^?k ef tort t^^ being the most specific. Preparing a WBS is swnilar to «itllnlng a ttrm 
?jjlr I^tueThni^^^ is to ask the question: "What has to be done In order toaccompllsh th.,7 

Example ^ 

On the following page a partial work breakdown structure haS been prepared for a career edu- 
cation prcliect» training materials for local career education coordinators and 
administrators. 

References/Resources ^ % 

'cook, Desmond. EducstiQf^at Pro/ect Management. Columbus, Ohio: Charles F.. Merrill. t971. 
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Obj«ctjva 




_-s , ^ 

Task! 


1, Conduct neods assessment. 

• 

• 

•> 

^ ^ — ^ ., ■ . — — 


cOmpetencigs* 


♦ 

search. 

(2) Review pertinent 
literature. 

(3) Prepare initial list of 
competencies. 


b. identify existing 

III VllrC 1 1 latiWi 1(1! 9 . 
f 


^41) Conduct materials 

(2) .Acquire and evaluate 

materials in terms of 
competencies coyered. 

(3) Prepare descriptions 
of^materials/. /' 


c. Cc>t;)si)lt with 

advisory committee. 


( 1 ) Select committee 
members. ^ 

(2) Convene committee 
to review initial list of 
competencies and exiSt* 
ing in-sei^ice materials. 

(3) Revise list of compe- 
tencies and description 
of materials. 

(4) Obtain critique of pro 
posed validation instru 
ments 

(5) Revise instrument. 

(6) Obtain committee recom 
mendations on type and 
form of in service mate 
riaEs needed,. 


d. Validate and rank 
administrator 
competencies 

" " ..... « . ..... . 


( 1 ) Select sirdtif ied sample 
of administrators. 

(2) Administer instrument 
to sample. 

(3) Prepare data for analysis. 

(4) Analyze data, ' 

(5) interpret data to deter 
* mine competency 

priorities, ^ ^ 
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* WORK FLOW CHART 

V 

■ • 

Background , 

' An essential ingredient in accompiishing a'task is time. The work flow i. th,»«eomp..*n«nt 
of tasks over time to accompli^ objectlvK. - 

Definition 

A work HOW chart is a way to depict tasks and their interrelationships over time. It c«i take 

several forms. 

r,mo AteW. A neh»ork Which illustrates activrties over time. The inter™latior«,ip. 

and constraints among the activities and objectives can be shown. 

' G«r, C/..rr A bar chart which illustrates activities over time. This type of chart doe. no. ' 
show the interrelationships among the activities and obiective.. 

,n addition to «.e .low o. tasks, several other items can be illustrated on networks end Genu 

charts. These include prbddcts and.decision points. 

» 

Products. Tangible products. 

mesto,m. A decision event or "milestone" in ^^^'^^^^'^'^^^^^^I^^^^T^r. 

major changes. 
. Events. Culmination or beginning of an activity. 

Example 

Development of a work flow chart requires several steps: 
' 1. Estimating how long each work activity will take 

2. Determining the interdependence and constraints between work activities 

3. Displaying the tasks and their relationships over time 
Displaying '^he timelines for other critical events in the work flow, such as products. 
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milestones anc( events 
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Example-Time Phased Network 



m 



n 



r 



1 Jul 



6a 



8a 



6a 





// lb 



1c 



2c 



I 



Id 



^ 11/15 



2a 



1 1 2 I 3 I 



O N, 



1 (at laeritity needed competencies 
iut"rn»fv existiny irvservice 

(ri Consul! with adviSOf y com- 

K'l Vdhdiite aad prlo^ltl^e admims- 

tfd'o' competencies 
? (j) Categorize related competencies 

:>» content areas 
•, t:.! SfU'Ct highest pnonty content 

j'Ods (ie.eijpment 



2b 



•4. 



2d 



12/30 



2c 



3a 



6b 



12/31 



▲ 

o 



11.1 

1/17 



Milestone 
Event 

Constf jint 
Tj»k Identifier 
Due Date 




-^io^C^ 12/31 



T"i r 7 t 8 I ' 9 ^ T 10 J 11 M2 J 



(cj 



fe) 



3 (a) 
(b) 
(c! 

(d) 
(e) 



Determine trajp^ng matenals 
format 

Prepare in-service tratriK^g 
materials 

Prepare user guide{sS for tram- 
mg materials 

Develop field test strategy 
Select test sites 
Orient personnel to fseld test 
procedures and nnsteriala 
Conduct fiei^J test 
Analyze f»eld test data 



_ I J \ 16 I 17 ^ lF 

M S O N D 

31 Oec 

4, (a) Revise training matenals using 

feedback 

(b) ^Revise user guidefs) using feed- 
back 

5. (a) Publish training materials and ' 

user guide(s) 
(b) Publicize and disseminate 
traming materials and user 
guideisj 

6 (a> Develop and submit quarterly 
prepress report 
<b) Develop and submit proiect fmai 
report 



s V EXAMPLE G^NTT CHART 




Morrtns 



1 Plan and Organize the Evaluation 

{ 



1.1 



2. Implement the Evatuaticrn 



2 1 



3. Communicate and Use the Evaluation Results 



2.2 
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CO 



3.1 



Evaiuatton Activities 



1. Plan and Organize the Evaluation 

1.1 Determine what information shouid 
be coliected, who wilf^se it, and how 
it will be ised. 

1 .2 Budget and assign staff for evaluation. 

1 .3 Organize for evaluation by developing a 
scope of work, a timeframe, and role 
responsibilities. 

2. Implement the Evaluation 

2.1 Develop/select instrument(s) 
for coHecting the information 

2.2 €oliect the information, 

2.3 Analyze and interpret the information, 



3.2 



>• 


3.3 


> 


3.4 



3. Communfcate and Use the Evaluation Results 

3.1 feuiid acceptance of the evaluation results. 
3 2 Prepare evaluation reports 

3.3 Disseminate evaluation results. 

3.4 Use evaluation results. 
Evaluation Products /\ 

1. Evaluation p^an 

2. Evaiuatton instaiment(s) ^ 

3. Evaluation reportis) 

Decision Points = O ^ 

1. The evaluation plan is reviewed prior to 
implementing the evaluation. 

2. The evaluation instruments^) is reviewed 
prior to collecting the data. 

3. The draft of the evaluation reportfs) is 
reviewed prior to dissemination 
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y TO DO LISTS 

Background 

In carrvmg out what «^ have to do it is easy to work on the ea^ '^)l^}'^'ZVZV!fLur 
difficult tasks until \a,x. Therefore, when you are faced w.th a number of t^ks. ^'^ m^^^ dif fi^^^^^ 
tasks tend to be pushed aside, and you never have time for the difficult, and probably the more Im- 
per tan t tasks. ^ i 

Definitions 

A to do list is a form for listing the tasks to do, a way of indicating when the task is completed, 
and the priority of the task. 

Example 

On the following page, we have presented a to do list form. !n most instances ^^^'^'^ 
pr.or."es wm suffice A- must be done immediately. B -needs to be done, and C-can be done later. 
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1. 

2. 
3. 
4. 
5. 

6. 
7. 
8. 
9 

10. 

.11. 
12. 
13. 
14. 

15. 
16. 
17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 



Thin^to do TODAY 
w DATE 
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FORCE FIELD 

t 



Background 

A problem situation exists when there Is a difference b^v«en the way ""^^ 
someone wants them to be. Kent Lewin borrowed a technique Ironj ^^^J^^^'^^f^^^^^^ The 
offered it as a wav to understand social problem situations. It is called the force field technique. The 
Td^aTs tharany siUtion is the way it is at a given moment because sits of co^nterbalarK,nfl forces 
are keeping it that way. 

Definition 

The force field technique provides a diagrammatic picture of the forces that are maintaining 
a situation at a given moment. 

Both the forces for and against attaining a given goal are enumerated. These forces are then 
analysed in order to develop strategies to chaQ^ the balance and meet the goal. 



Example 

Diagnoses. In the force field technique, you start by writing a problem statement at the t^of 
a page and drawing a line down the middle. The line represents the way t^"^^;^ "^^q;^ dott^ 
Ime dowr the right hand side of the page represents how you would like things to be. On the left 
half oHhe pai write down all the important forces that help push you toward «^^j«;';"9 J" 
On the nght half of the page, write down forces pushing against movement toward your goal. A 
force field diagnosis is iMustrated below. 

Analysis. The next task is to analyze the forces to determine which ^I^^.'PJ^JIJP^^"^ l^^^. 
most potent in moving you toward or keeping you away from your goal. Th.s involves three steps. 

1 Rank the forces in numerical order as to importance. Importance is defined ^significance. 
How important or significant is a force in yielding the most movement toward the goals? 

2. Rate forces as to strength or resistance to change. How easy or hard would it be to change 
the force? Is it hard, medium, or easy? 

3. Rate the forces as to clarity of evidence. What evidence is there that it is a force? How 
clear is it to me that it is a force? 

A force field analysis is illustrated below. 

Strategmng. The next task is to plan strategies to work around the strong negative forces and 
to maximize the strong positive forces. This can be accomplished m four ways. 
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Add' a force 
Eliminate a force 
Strengthen a force 
Weaken a force 



frormt Fi^d Dlagaotif 



Problem Statemenf! You set a ^6a\ ^or me to lo^ five ptHinds during ttie next two weeks. 



• Opposite 
' of Goal 

i . 
i 
I 
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Forces For 
1 



I tend to be a li^t 
eater. 

I want to save some 
money. 

We are visitifig my 
motherin-law this 
wee1<^end and I don't 
li>;e her cooking/ 



Now 
i 



2 
c 

O 

i 



Gear 



Forces Against 



i 
i 



I am presently about thj^ 1 
pounds underweight. 

I don't wartt to accept 
this goal. 

My mother-in-law will be 
unhappy if I don't eaV^H 
while visiting her. 



o 
c 

4C 
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fore* Fi«td Analysts 



r 



Problem Statement: 



Opposite 
of Goal 
i 
i 
i 



Districts are not sharing their career education infusion strategies with each 
other which leads to "reinventing the wheel." 



Now 

i 



t 



Goal 



Forces For 



forces Against 



o 

to 
? 



(6)* (C)"* The state 
coordinator wants to see 
sharing. 



(1) (PC) Seme iocal 
coordinators have 
exciting ideas to share. 

(3) (PC) Some districts 
want to know moil 
about other efforts. 

(8) (U) Increasing 
demands to be more 
effective; 



(7) (C) (M)""" ThtesHte 
coordinator doesnTt want 
to ifppose more demands 
on local coordinators. 

,(2) (PC) (E) Concern that 
time spent sharing ideas 
will be wasted, 

(8) (PC) (M) Local 
ownership impedes 
sharing. 

(5) (U) (H) Fear of 
sharing mistakes, 

(4) (C) m Fear of 
insufficient time to 
meet current demancis 



5 



Goal. 



To increase communication and support for sharing career, education infusion 
strategies across the state. 



Strategy: Get more information from a district you think has some good ideas about 

ex^tly what they are doing. Encourage this district to present their strategies 
in the next state newsletter. 



ERIC 



' Rank : 1 is highest importance 
Ctantv C -Clear. PC Partly Clear, U Unclear 
■Titrcnqtf t H Hard, M MfKiiuin, f f asy 
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ADVISORY COMMITTEES ^ 



! 

^ckground 

Most coordinators of career education have very limited staffs to work with them. Often the 
coordinator .will need to work with advisory committees in carrying out a planned sequence of 
activities. It is not unusual to involve advisory committees in the evaluation of career education. 

Definitions ^ < 

An advisory committee is a group of persons who are appointed to flive directlorw to yourcareer 
education program. This group of individuals needs to represent business, industry, la^r «jd the 
professions. Additionally, it should include both males and females and repreaentatives of diffarent 
races and cultures. 

Examples 

The Ohio Department of Education has established a Program Review for Improvement, 
Development and Expansion (PRIDE) for evaluating career education by use of an advisory com- 
mittee. Their committee is composed of the following individuals^ a local career education coordi- 
nator a counselor, an elementary and/or secondary teacher, a vocational teacher, a buildmg «Jminis- 
trator two students, two parents, two lay citizens anrf two persons from locaf bufinew or industry. 
The Sumr^ary Review Statements Form is presented on the next page. The complete form is avail- 
able from the Onio Department of Education. 

References/Resourcas * • 

Program f^eview for Career Education, Columbus, Ohio: Ohio State Department of Education, 
June, 1976. 
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Summary Riview Ststtmfiits 



Dirtctions: Each committee member is request to make a checki^gartling cH)inions of the career 
education program. For each summary review ststement, place a ^eck (/) In the column which best 
descHbes your Impressions of the career education program. 







lent 










Outst 


Excel 


Good 


Fair 


a. 


■ nil ii.iii Ill .11. . mil iiW'i—i — ^ 


5 


4 


3 


2 


1 



I. CAREER EDUCATION STAFF 



li. 



III. 



IV. 



To what ext 
to fulfill its 



CAREER E 
MATERIA 




t is the career education staff adequate 
le in achieving the program objectives? 

UCATION FACILITIES AND 



B. 



To wnat extent is there sufficient space" and 
materials to provide for a variety of projects 
to carry out the objectives of the program? 
To What extent are facilities and materials 
utilized in the most efficient martngr so as 
to realize program objectives? 



CAREER EDUCATION COORDINATION 
AND ADMINISTRATION 

To what extent is coordination and administration 
of the career education program faciiitating the 
meeting of stated program objectives? 

PERSONNEL AND CURRICULUM 
DEVELOPMENT 



[■J 



n 



! J 



rj 



ci 



.1 1 



A. To what extent are the developmental areas 

infused into the curriculum? L J 1 I L J 1 - tJ 

S, To what extent are the USOE clusters incor- 
porated into the orientation curriculum? I J 11 II i 11 

C. To what extent does the entire career edu- 
cation staff attempt to sensitize itself to the 
inservice needs of the teachers in the career 

education schools? ' i 1 I : [ J i ! ! 

V, ADMINISTRATION, COUNSELOR; AND TEACHER 

To what extent is the administration, counselor, and 
teacher participation directed toward meeting the ' 

career education program objectives? ' 11 I J I i i i M 

♦ 

NOTE: The average rating should be computed for the report of the career education chairperson. 

H-2 
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CONSULTANTS 



Background 

Career education coordinators sometimes need the services of specialized help for shoH periods 
time. These short term requirements often are filled by employing consultants. 



Definitions 

Consultants are individuals who are called upon for professional or technical advice. ^ 
Exampies 

Martha Wilhams at The Network developed a Program Planning Packet (1976) for project 
manaqers wh.ch outlines ten tips for consumers of evaluation consultant services. These are: 

1 So c.t recommendations for evaluation consultants from other consumers-project 
directors, school district adm inistrators, state department of education personnel, or a 
fiuman resource file. 

9 F Hid an educational evaluator, not simply a person with strong statistical or computer 
background The consultant should have experience in evaluating educational projects 
(both p'cKess and product evaluation) and be familiar with design consiramts and alter- 

natives. 
« 

1 When you have identified candidates, ask them for names of other clients they have 
sj'rvpd it's wise to talk with a few others who have worked with the consultant to learn 
.,hout his or her style, expertise, and ability to work within a schedule. 

4 Choose a consultant easily accessible to the project. A consultant who is geographicaliy 
( lose to the project site can be available for meetings, on-site data collection and report- 
ing, dnd other aspects of the formative evaluation process. Also, keeping travel costs 
down fielps to make the evaluation cost effective. > 

b Determine the cost of evaluation in advance, based on what is budgeted or what can be 
transferred to an evaluation line item. A good rule of thumb established the cost of 
evaluation between three and eight percent of the total project budget. 

6 Nctflotiate with the consultant for frequent OQ-site visits to discuss procedures, interim 
resSts, and problems which arise. 

7 Contract carefiiiiy with the consultant. When formulating a contract with an outside 
..valuation consultant, the following things should be considered: (a) who has title to 
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the data-make certain that the project, not the.evalyator, has that title; (b) the exact 
terms. of the evaluation-vyhat is expected of whotri, when^lc) the number of days on-site; 
{d) the itemized budget f6r the evaluation and (e) a cancellation 0<ause allowing 30-day 
notice for cancellation olF the contract for both the project and the evaluator. The contract 
should be in writing, signed by both client and consultant. 

Be sure the consultant is introduced to and accepted by key individuals involved in the 
evaluation. -If the consultant meets resistance in obtaining data, the ev&Ui^on will be 
weakened. ^jPt 




Consider haviiig the consultant conduct inservice sessions for project staff and teachers to 
acquaint them with the purposes and procedures of evaluation. Be sure staff understand 
the way in which the results of the evaluation will be used. 

i 

Establish the evaluation design as a cooperative effort involving the project director, the 
project staff, and the evaluator. This involvement will increase the usefulness of the 
-study and results, take into account reality factors and limitations, and ensure that the 
consultant's interests and orientations do not overly influence the design. 
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DECISION EVEWT REVIEWS 

Background 

Decision event reviews provide an excellent opportunity to have eternal reviewers r«/iew 
outputrdeveloped b" staff. As . device to lend credibility and object.v.ty to an effort, the 

involvement of externa! reviewers is excellent. ■ 

Definition 

important points in the 111= of a program should be identified as likely decision events In a 
state level career education effort. These points would be; 

After drafting a plan but prior to implementing it 

-. After drafting an evaluation instrument but prior to collecting the data 

- After drafting a manual or report but prior to disseminating it 

Each of these decisior. events is an important future oriented step in an effort that could benefit 
from a reappraisal. 

Example 

A dGCisioti event should int.lude- 

1 . Claims or cr.tena for the product (e.g., plan, mstrument, report) being reviewed 

2. information that supports these criteria 

3. Decision alternat.ves (e.g., no changes, minor changes, major changes) 

4. Opportunity for spec.f ic comments and recommendations of the reviewers 

5 A rev,^a process (e.g., mailing out the product to revievvers, bringing in consultants 
for the day, etc.), a time for review, and persons to conduct the review. 

A sample decision event review form for a career education evaluation instrument is presented. 
References/Resources 

« 

A source list of criteria for decision event reviews is attached. 
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SAMPLE DECISION EVENT REVIEW FORM 
FOR AN EVALUATION INSTRUMENT 



Ctiim 



Evklanct 



CkKTimtriti/RKomrmndatiom 
of RiviiVMini 



Congruence. The items are 
logically derived from the 
program objectives and 
activities. 



See instrument. See 
program objectives. 



B 



The items on job hunting 
ernphasize different sk\\\s 
ihan the original qbjectives 
in this area. 



Comprehensiveness, The 
items cover all significant 
s^tets of the program. 



See instrument, A test 
bfUeprint was used in 
developing the items. 



Additional items should be 
developed to measure affec* 
tfve outcomes, e.g., attitudes 
toward learning, desire to 
'work, self confidence, 
maturity, self-understanding, 
and interpersonal skills. 



Importance. The items 
measure significant 
as opposed to trivial 
learnings. 



See instrument. An ad^ 
visory panel of teachers 
and students reviewed 
the instrument. 



B 



The items on decision- 
making skills are trivial. 



Clarity, Instructions 
are clear, items are 
straight forward and 
unambiguous. 



See instrument. The in 
strument was pilot 
tested with a group 
of students. 



Instructions are excellent^ 
Items are clear snd simply 
stat^. 



Decision Alternatives 
A — Adequate, no change 
B - Minor changes 
C Major changes 
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SOURCE LIST OF EVALUATION CRITERIA 
FOR CAREER EDUCATION PROGRAMS AND PRODUCTS 



Desirability 

- Priority of need 



Relevance ^ 
Size of affected population 
Fit witti ongoing program/activities 
Uniqueness 
Marketability 



Intrinsic Quality 



Utility 



ERIC 



Social fairness 

Accuracy 

Consistency 

Clarity, editing, printing, physical quality 

Instructional quality 

Readability 

Scope, selection, and balance 
Attractiveness/aesthetics 

EviTn«^Cf ^ process in Jeveiopment (e g., literature reviews, pilot tests, field tests, 

etc.) 



PraclicaUty 
Poiiticai viability 
Leverage 
Timeliness 
Credibility 

Audience accommodation 
Flexibility 
Pervasiveness 
Durability 

Amount of training/prep requifed for use 
Visability of effort during development 
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Dirsct Effectiveness 



How well output meets objectives judged to be important 

Long term effecte 

Number of effects 

Scope of effects 

Comparative effectiveness 

Efficiency in attaining effects 

Credibility of evidence for effectiveness {reliability, validity, generalizability) 
Cost effectivene^ 



indirect Effectiven^ 



Model for ottier work 
Contribution to knowled^ 
Adaptions 
References 
)inoffs 
policy changes 



I 



J-4 



ERIC 



BUDGET REPORT 



Background 

Information related to how you are actuaUy spending against a planned budget is an important 
controlling function. If you are to make the most efficient use of funds, you will need to be able 
to compare actual vs. planned expenditures every month.. ^ 



Definitions 

Budget reports are graphic and num6nc representations of planned and actual project ex- 
penditures. These reports are generally pre^red on a monthly basis. 



Example • 

The following presents a sample of how a budget report could be prepared. The report 
allows you to plot planned expenditures and, on the same chart, actual expenditures. 



References/Resources 

Cook, Desmond. Educational Project Management. Columbus. Ohio: Charles E. Merrill, 1971. 
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BUDGET REPORT 



Proi, Oif 



Program Code 



Bif dgit Aceimni 
Fynding foriod: 
Funding Source 



Titie 



to 



Amount 



Month! 
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Budget P«ta : 

1 Budgeted Ta Ocjtw _ _ 

2. Unencumbered TiilancL- 

3. Months Remaining in PrcHjrurn _ _ _ 

4. Awera^ Costs pet Month :o SptJnd Out (2 4 3) 
Rsmarks: 



Sp<2nt To-DitiS 
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PROGRAM ASSESSMENT 



Background 

In conducting career education activities, it is helpful to be able to determine what it is that 
needs to be done and your related progress. Unless you develop and ke^ track of the long term 
plan you may not get to wvherd you are headed. 

Definitions 

, A program assessment is a list of career education program indicators and a rating scale for 
reporting your progress. This *orm is intended to be completed by the career edifcation coordmator 
and his/her steering committee. 

Example 

The following page presents a sample from the career education program assessment form 
developed by the Michigan Department of Education. 



L'1 



CAREER EDUCATrON PROGRAM ASSESSMENT 



Has Bmn 

CompletiNi 
(induchi dati) 



Mafcins 
Progmi 



Not 
Btgun 



Hot 
Appltubi* 



Commtnti 



1. LEA Career Education Coor- 
dinator hes bean appointed 
by the Superintendent. 

2. LEA Career Education Coor- 
dinator has identified his/her 
role and function. 

3- LEA Steering Committee has 
been appointed and has the 
approval of tN Superin- 
tendent and. if necessary, 
the Board of Education. 



□ 



□ 



n 



11 



L.] 



4. LEA Steering Committee has 
met and has determined its 
role and function. (See 
Supplements A and B) 

-Selects chairperson (i.e., 
Principal) 



r " 1 
I J 



C3 

[j 



-Establishes goals for 
committee 



! "1 



□J 



Forms various sub- 
committees 



i J 



'Determines procedure for 
arnving at decisions and 
recommenciations and 
how these wiH be com- 
municated 



ERLC 



Advisory Committee has 
been established and has 
determined its role and 
function 

The LEA Career Education 
Steering Committee has de 
veloped a written xJefmition 
of the concept of career 
educatfon/ 



□ 



PROGRESS REPORT 



Background 

A brief report is often needed that gives a project monitor an update ori planed activities. 
This .nformation Is generally reported on a one or two page fornn. By reviewing this form, an 
individual can get a general overview of the project's progress. 

\ 

Definitions ■ ^ 

A oroaress report genarally summarizes the major activities conducted during a month, identi 
fed pres^m and an "cipated problems, and lists the dates of project milestones, dec.«on events. 

and product due dates. 

Example 

' The progress report on the following page represents one such progress report. Several differ- 
ent modifications in this report are possible. 



References/Resources 

Cook, Desmond. Educational Project Management. C ''imbus, Ohio: Charles E. Merrill, 1971. 
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Project Monthly Status Rtport 

' Month of 

Project Title . 



Project Director 



1. Estimate overait schedule status of the pt^oject as of the end of the month (making reference 
to specific activities if nece^ry): 

• on schedule 

days early 

days late 



2. Summarize ttie major activities and accomplishments of the project during the month. 



3. Describe any critical events or problematic situations affecting the project, including changes 
in scope-of-work, schedule, and/or budget. 

Present; 



Anticipated. 
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USER FEEDBACK 



Background ') 

Consults of career education c^n often provide the most useful *««^ack about iteeff^^^^^ 
ness. Consumers can include local coordinators who read a 

inservice, as well as students who participate in career education activities. The^ are a variety of ^ 
techiiiques to elicit user feedback. - • 

Definition 

User feedback can be focused on collecting candid F^rceptions of the use. quality, efficiency 
•^or effectiveness of a career education experience from its participants. 

Example 

EKamples of user feedback forms for a conference, for a seminar, for a newsletter, and for a 
product are illustrated on the follov^ing pages. 

References/Resources 

" The -Use of Career Education Newsletters" and "Use of Career Education Handbook" are 
, from Newton, Mark and McCaslin. N. L.. An Evaluation of Three Communication Mecham$m 
J Utilized by the Cashmere Career Education Program, The Center for Vocational Education. 1977. 




The "Model Daily Feedback for Conferences" and the "Model Sernin^r Foi1ow-up Question- 
e" are from Adams. Kay Angona^ A Ten Year Perspective on Conducing and Evaluating 
Warship Development in Vocational Education, The National Center for Research in Vocational 
iS^tion, 1978, 
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Use of Career Education Newsletters 

part of this project/ newsletters were sent to rural school districts throughout the United 
States. A copy of the logo used on these newsletters is printed at tCie top of the first page of 
this questionnaire. Have you seen one or more of these newsletters? {please check one) 

1 Yes, I have seen some newsletters (please go to question tvo). 

t i r^o; I have not seen any newsletters (please go to next seqtion). 

How did you review the newsletters? (please check as many as apply) 

LJ I did not look at them. 

11 I scanned the newsletters rapidly. 

L ] i read selected portions of the newsletters, 

i ! I read the newsletters thoroughly. 

I J Other jple^e specify): J 



Which portion(s) of the newsletter did you usually read? (please check as many as ^pply) 

I ' Feature story on front page 

! '] Articles describing teaching practices 

; ; Articles describing career education materials that are available 

Articles describing meetings aad conferences 

. i Articles describing management practices m career education (e.y., how to organi/e a 
program, how to evaluate, etc) 

What did you do with your copy of the newsietter(s) when you finisfmd witii it (them)^ 
(please check as many as apply) 

t kept them tor my personal usi?., 

[ i I circulated them amon?^ other school staff in our district. 

[ : I sent t^ern to colleagues outside our district. 

i ; i placed .hem in a library or readirxj room. 

1 ; I announced the existence of \he newsletters in our own iiewsletter or similar notice. 
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1 I 
I ; 



t don't remember what I did. 
Other (please specify); 



5. Which of the following uses have you made of the information in the newsletters? (please 
check as many as apply) < 

1 1 I have told others in my district about specific items that I read, 
I 1 I have sent to get materials described in the newsletters. 

! ' I have written for more information (other than materials) from people mentioned in 
the newsletters. 

1 I have visited programs or activities described. 

I '■ I have talked to people mentioned to get more information (other than those I ta'ked 
to on visits). 

i I have used the information to design a career education program or activity for students. 

I have used the inforniation to Improve a career education program or activity for studeni 
I ' I have used techniques described in the newsletters in working with the community, 
i I have used information to evaluate a career education program or activity. 

I have used the mforrnation to design or conduct inservice training for staff. 
■ ' ! have not used any of the information to date. 

Other (f)iease specify! 
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Use of Career Education Handbook 

Another aspect of this project was to develop b handbook for use by rural educators in imple 
mentlng career education in their settings. Have you seen this handbook? (check one) 

I } Yes (please go to question two) 
i J No (please go to next section) 

How did you review the handbook? (please check as many as apply) 

IT] I did not look at the handbook, 

r 1 I scanned the handbook rapidly. 

II I read selected portions of the handbook. 
1 J I read the handbook thoroughly. 

I 1 Other (please specify) 

Which section(s) of the fiandbook did you review? (please check all chotces that apply) 

1 1 I reviewed the entire handbook. 

t ! I reviewed only the following sectionis) ; 

i ^ Introduction 

i i Why Career Educatipn 

; Career Educat(on m Rural Settings 
1 Creating Career Education Curriculum B 

■ I Involving the Community 

; ; Evaluating Your Program 

1: Bibliography ^ 

^ What did you do with your copy of the handbook when you were finished with iti^ (please 
check as many as apply) 

1 ] i kept It for personal use. 

I : I circulated it artiong other school staff in our district. 
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I sent it to colleagues outside our district. 
I placed it in a library or reading room. 

I announced the existence of the handbook in our own newsletter or similar notice. 
I don't remember what I did. 

« 

Other {please specify) ^ 



1 t 



Which of the following uses have you made of the information in the handbook? (please check 
as many as app^y) 

I 1 I have told others in my. district about specific items that I read. 

I 1 I have sent to get materials described in the handbook. 

II I have written for more information (other than materials) from people mentioned in 
the handbook. '» 

1 ! I have visited programs or activities described. 

I have talked to people ment.oned to get more information (other than those I talked to 
on visits). 

I have used mformat.on to design a career education program or activity for students. 

I have used the mformation to improve an on going career education program or activity 
for students. 

I have used the techniques described m the handbook m working with the community, 
i have used the mformation to evaluate a career education program or activity. 
I have used the mformation to design or conduct inservice training for staff. 
I have not used any of the information to date. 

Other (please specify)" „ . ~ 
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Model Daily Feedback for Conferences 

Date ] 

instructions* Place a check in the most appropriate box in both the left and right columns for each 
presentation. In the space for commen,ts, provide specific commendations and recommendations 
for improving each presentation. 

\^ 

U$8furne$$of Effectiveness of 

the Information Topic the Preientation 

Low High tow , Higjh 

12345 12345 

L"J [J a U Ll "Setting the World on Fire" 11 [J 11 ll I') 

Jane Jones 

Comments: 



[ J L ] I J "An In-depth Review of Everything" ( ^ 

Michael Smith 



Comments 



"Our Great Contributions to Mankind" I ' ^ ^ ^ ' 



John and Mary Doe 



Comments: 
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1 . What was of mmt value to you in today's sessions? Why? 



2. What was of feast value to you in today's sessions? Why? 



3. What are your recomrnendai.ons to the conference planners for improving today's activities? 
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Mcxiei Seminar Fo|tow-up ChiestionnairB 



instructions: For questions 1 through 3, circle the number which most accurately represents your 
response. Consider the numbers to be o^ a continuum from high to low. 



1 . How often have you used the skiltg learned at the 

session attended 



19 



? 



Frequently 
^1 2 



High 
5 



Positive 
Direction 



Negative 
Direction 



Has your attitude about the role of the session 
attempted to prepare you for changes? 



Do you find the new information you have 
learned from the session applicable to your 
organizattbnai setting? 



Many 
Times 



4 



Never 
5 



Please rank the skills listed below in terms of ^heir usefulness since completion of the session. 
If any of the skills have not proven useful, please rank them "0." 



Rank 



Skill 



Rank 



Skill 



f . 



6. 



2. 
3. 
4, 
5. 



. 7. 
. 8. 
9. 
10. 
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